Bard McKinley's profile

Jibo - Skill & GUI Development

I had the unique opportunity to be part of the team that developed the world's first social robot for the home, Jibo.  While at Jibo Inc. I developed Jibo's skills as well as core features of his API such as the GUI framework and a system that helped enable remote control of Jibo via mobile apps.
GUI Framework

When I first began at Jibo there was not much in the way of an API when it came to the creating GUIs and other displays for Jibo's touch screens.  I proposed and developed a framework that other skill developers could use within their skills, that streamlined GUI creation, asset loading, touch interfacing, as well as management of the page transitions that abided by the Design teams specifications.
Demo of GUI framework for Jibo
These videos capture only Jibo's screen in order to clearly demonstrate the GUI framework's components and view management.
Demonstration of the List component behavior and its extensibility
Demonstration of broader use of GUI framework using a variety of components and modal views
Robot Skills

I also worked on a number of Jibo's 'skills', which could be thought of an kind of focused experience for a specific task.  Though it passed through a number of development hands I was ultimately responsible for the development and collaboration with design on the photo taking skill Snapshot and Photobooth, which was an interesting skill as it used the majority of Jibo's wide ranging HCI channels.  I also developed and helped design Jibo's tutorial skill, the Yoga skill, and the Main Menu, as well as contributing to the design of the computer vision driven game Circuit Saver and Word of the Day.
Snapshot skill has found a face and is about to ask for a smile
Start of Jibo's yoga skill, which guided users through yoga routines that were synchronized with his body animations and screen visualizations
Remote Control Support

The Be A Maker app was created by Everis, but was able to communicate commands to and get response from Jibo via the command system that I created on the robot.  My team worked with the app makers to make sure that all of the controls required by the app were implemented on robot and working efficiently.
Brief trailer for be A Maker, an app making use of the command system I worked to create
Jibo - Skill & GUI Development
Published:

Jibo - Skill & GUI Development

Published: